Acting on information: Representing actions 
that manipulate information 

Topic: Representational Formalisms (Action) 

Keith Golden 

NASA Ames Research Center 
M/S 269-2 

Moffett Field, CA 94035-1000 
kgoiden@ptolemy.arc.nasa.gov 

November 1, 1999 


Abstract 

Information manipulation is the creation of new information based 
on existing information sources. This paper discusses problems that 
arise when planning for information manipulation, and proposes a 
novel action representation, called adlim, that addresses these prob- 
lems, including: 

• How to represent information in a way sufficient to express the 
effects of actions that modify the information. I present a simple, 
yet expressive, representation of information goals and effects 
that generalizes earlier work on representing sensing actions. 

• How to concisely represent actions that copy information, or 
produce new information that is based on existing information 
sources. I show how this is a generalization of the frame problem, 
and present a solution based on generalized frame effects. 

• How to generate a pipeline of information-processing commands 
that will produce an output containing exactly the desired infor- 
mation. I present a new approach to goal regression. 
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1 Introduction 


There are many problem domains that consist largely of actions that manip- 
ulate information. For example, image processing tasks consist of taking one 
or more input images, transforming them in various ways, and writing the 
result to one or more output files. Network administration also involves sub- 
stantial information manipulation, such as backing up files, applying patches 
to software, compiling and installing programs, modifying configuration files. 

This is the sort of task that planner-based softbots 1 [4] were designed 
for. However, the information manipulation problem is beyond the grasp of 
current softbots. There has been considerable work on developing planners 
for gathering information, but almost no work on planners for manipulating 
information. That is not because manipulating information is unimportant, 
but because representing actions that manipulate information is hard. 

This work builds on experience with the Internet Softbot [4] and on cur- 
rent efforts to build softbots for information manipulation tasks at NASA. 
Years of building a domain theory for the Internet Softbot made clear the 
representation language’s strengths and weaknesses, which led to a number 
of improvements, as discussed in [6, 8, 7j. One area where it has remained 
weak, indeed where all action languages are weak, is representing the infor- 
mation content of files. The copy action was never cleanly or accurately 
represented, and we were unable to represent Unix pipes (which redirect the 
output of one command to the input of another). Actions like tar (which 
creates an archive of a collection of files) were out of the question. 

This paper discusses the reasons why it is difficult to represent such ac- 
tions in previous action languages, and presents a new language, ADLIM, that 
addresses these problems. ADLIM stands for Action Description Language 
for Information Manipulation. ADLIM is based on Pednault’s ADL [19J, and 
strongly influenced by SADL (Sensory ^vdl). [6] Whereas SADL focuses on 
gathering information, ADLIM focuses on manipulating information. 

1.1 Roadmap 

Section 2 introduces the ADLIM action language, defining the semantics of 
effects and goals in terms of the situation calculus. Section 3 discusses the 
problem that occurs when information is copied, shows that this problem is 

'Softbot stands for software robot. 
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a generalization of the frame problem, and introduces a new kind of effect 
to deal with it. Temporal projection is fundamental to planning. Section 
4 discusses temporal projection in adlim, providing a sound and complete 
goal regression operator. The full paper will also discuss a new technique 
called goal progression , which ADLIM’s unique representation allows. The full 
paper will also discuss the relationship between information manipulation 
and information gathering, show how the latter is handled in ADLIM, and 
discuss how a planner can reason about the completeness of information 
contained in a file, using Local Closed World reasoning [3|. Section 5 provides 
a brief example of ADLIM actions and Section 6 discusses related work. 

2 Information manipulation in ADLIM 

Since the goal of ADLIM is to represent actions that process data inputs and 
produce data outputs, inputs and outputs are explicitly declared in action 
descriptions. Every variable is declared as an input, output, parameter or 
quantified variable. Inputs and outputs are distinct from other variables in 
that an input is not guaranteed to exist after the action is executed, and an 
output does not exist before the action is executed. 

An action that has no inputs and one or more outputs is called an infor- 
mation source. An action that has one or more inputs and no outputs is an 
information sink. An action that has one or more inputs and one or more 
outputs is an information filter. An information filter processes the inputs, 
producing the outputs. Contrary to the behavior of a physical filter, it does 
not necessarily remove anything from the input, and may add something or 
change it completely. 

2.1 Background: The Situation Calculus 

I define the semantics of ADLIM expressions by mapping them into the situ- 
ation calculus [16], a first-order logic used to describe changes to the world 
resulting from the execution of actions. A situation is a state of the world at 
a given time. A fluent is a function or proposition whose value may change 
over time. To indicate the value of fluent <p(x) in situation s, I will write 
<p(x, s). At any one time, there is some situation s that holds at that time, 
and for any boolean fluent <p(x), either <p{x,s) or ->tp(x,s). Thus, the set 
of ground facts holding in situation s comprises a complete logical theory. 
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However, if an agent has incomplete information about the world, it can- 
not know what the actual situation is, since that would require knowing the 
value of every fluent. Thus, there are many other situations that might hold 
instead. Following [21] and many others, I represent these situations using 
the predicate K. /C(s', s) is true if and only if it is consistent with an agent’s 
knowledge in situation s to believe that the actual situation might be s'. 

All changes to the world are assumed to be the result of executing ac- 
tions. The special function do is used to represent these changes. do(a, s ) 
returns the situation that results from executing action a in situation s. 
{a}” represent a sequence of actions ai;a 2 ;... ;a„. do({a}",s) is equiva- 
lent to do(a n> do^Qn-i, . • • do[o,\, s))), i.e., the result of executing the entire 
sequence, starting in situation s. s 0 represents the initial situation. 

Since ADLIM expressions are not themselves objects in the situation cal- 
culus, I introduce the following predicate, which takes ADLIM expressions 
as arguments. HOLDS(E, {o}”,s) means that the ADLIM expression E be- 
comes true as a result of executing action sequence {a}? from situation s. 

2.2 Effects 

Uwl [5] and SADL represent information-producing actions using the anno- 
tation observe. For example, to represent that executing the action Is /bin 
reveals the name of every file in /bin, the sadl encoding would be: 

V/3n when (in.dirC/, /bin)) observe (name (/, n)) 

However, the encoding using the observe annotation does not actually rep- 
resent the effects of Is, but rather the combination of Is with a program 
to interpret its output and produce a set of knowledge base updates. Such 
a program is called a wrapper. Since a filter works on the syntactic output 
of a program, not the semantic interpretation, using observe throws away 
vital information that a planner needs to successfully create a data pipeline. 
Instead, I divide conditions that can be sensed into two categories: 

• simple observables are functions or relations whose value is inde- 
pendent of the situation in which they are evaluated. An example of a 
simple observable is the relation contains("foobar", "foo"). It is easily 
answerable by examining only the syntactic representation of "f oobar" 
and "foo". For every simple observable, there is a function that returns 
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its value (if all arguments are bound), or provides additional constraints 
for its arguments (if some arguments are bound). Formally, 'F is a sim- 
ple observable if for any variable substitution 9, either 'id or -» 'id is 
true in all situations: 

V0 [V.s(s t= 'id ) V Vs(s (= -W)] 

• contingent facts are functions or relations whose value depends on 
the situation. For example, the relation in.dir(foo,/bin), which means 
the file f oo is in the directory /bin, will be true in some situations and 
false in others. A sensing action can be described using conditional 
effects, where the antecedent refers to the situation in which the action 
is executed, described using contingent facts, and the consequent refers 
to the contents of the output, described using simple observables. For 
example, the effect of Is discussed above would be represented as 

V/ (parent. dir (/) = /bin) -»• contains-line(name(/) , out ) ' 

This translates to “For each file in directory /bin, there is a line 
in the output that is equal to the name of the file.” 2 The — ► is 
used instead of when to indicate a conditional effect. The reason 
for this notation will become clear in Section 2.3. 

Nested expressions like contains-line(name(/) .out) in the above example are 
nice notationally but awkward for a planner to work with. They can be de- 
composed by introducing additional variables. For example, if n =name(/), 
then the above can be rewritten as contains-line(n.out). However, it is nec- 
essary to decide which side of the — > the n =name(/) belongs on. That is, 
does n refer to the name of / before the action is executed or after? I adopt 
the simple rule that, by default, sub-expressions like name(/) always refer to 
the situation before the action is executed. The exceptions to this default 
will be spelled out in the full version of this paper. 

Effect Semantics 

The semantics of effects is mostly straightforward. I will explain the seman- 
tics by translation into the situation calculus. Let s a be the situation before 

a This describes the “piped” version of Is (which is appropriate in this context), without 
any flags. More complex versions of Is, such as Is -1, can also be easily represented. 
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the action a is executed and let .■>* be the situation that results from executing 
action a in situation s 0 (st, = do(a, s a )). Translation consists of converting 
the — > into an implication (=>) and specifying the situation that each expres- 
sion refers to. Each fluent will acquire an additional argument referring to 
the situation. For example, name(/) becomes name( /, s ). Fluents left of 
the — * pertain to s a and those on the right pertain to s*. For example, the 
effect of Is discussed above translates to 

V/parent.dir(/, s a )=/bin A n =name(/, s 0 ) => contains-line(n, out, s&) 

I sidestep the ramification problem by making the STRIPS assumption: Any 
proposition that is not explicitly made true or false by an action remains 
the same. The only exception is that if the value of a function is changed, 
it is not necessary to declare that the previous value no longer holds. For a 
formalization of the STRIPS assumption in the situation calculus, see [ 21 ]. 

Any effect can be rewritten so that each consequent appears only once. 
First, conjunction is eliminated in the consequent by replacing expressions of 
the form <£ A <p 2 with ($ -+ <pi) A (<$ — ► <^2)- Then effects of the form 
$ — > <p and 'F — > <p are combined into a single effect ($V^) — > <p. Disjunction 
is only allowed in the antecedent of effects, so after this transformation, 
the effects can be specified completely by listing the preconditions of each 
(possibly quantified) literal <p or -up. For each literal <p, let yj(a) be the 
condition required for action a to make <p true, and let 7 £(a) be the condition 
needed to make <p false. If o does not affect <p, then 7^ and 7^ are both false. 
Since the effects of a must be consistent, ->7^ V ->7^. For simplicity, I assume 
in this discussion that no effects cause <p to become unknown, but see [ 7 ] to 
see how that is handled. It then follows that 

HOLDS ( -v (p, a, s) => ^(s) =* <p(do(a,s))) 

2.3 Goals 

Information manipulation goals, like effects, must be explicit. Consider the 
goal of outputting the result of a query to a file. Merely ensuring that the file 
contains the information is not sufficient. For example, a list of file names 
should not be mixed up with a list of userids, since it may be difficult to tell 
which is which. Furthermore, if the file is to be read by another program, 
there will be exact formatting requirements. 
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Suppose my goal is to to produce a killfile, which is a list of email ad- 
dresses that I don’t want to receive email from, each on a separate line. Let’s 
say I don’t want to receive email from anyone who has sent me a message 
containing the string "MAKE MONEY FAST." I might express this goal as: 

Vem email-received (em) A 

contains (subject (em) , "MAKE MONEY FAST") 

— ► contains-lineCsender(em) , killfile) 

This has the same form as the conditional effects discussed in Section 2.2, but 
the meaning is slightly different. Whereas, in effects, the statement A — ► B 
indicates that if A is true before the action is executed then B will be true 
after the action is executed, in goals it means that if A is true before the 
plan is executed, then B must be true after the plan is executed. Thus, A is 
similar to an initially goal in SADL and B is similar to a satisfy goal [6j. 

As was argued in [8, 6], information goals are inherently temporal. It 
doesn’t make sense to ask about the value a fluent without specifying at 
what time the value of the fluent is to be sampled (and at what time the 
answer is desired). This notation assumes information goals are of the form 
“Tell me ASAP the value that these fluents have now ” or, more generally, 
“Act ASAP on the current value this expression.” 

Goal Semantics 

The structural similarity between goals and effects is not coincidental. The 
semantics of a goal is equivalent to the semantics of an effect, with the ex- 
ception that the temporal extent of a goal is the entire plan, rather than just 
a single action. That is, s a is replaced with So, the initial situation, and s&, 
is replaced with s n = do({a}”,so). 

The — ► in goals represents implication between a formula in So and a 
formula in s n , but often bi-implication is the desired interpretation. For 
example, consider the above example. Including the email address of every 
person I’ve received email from would satisfy the above goal, but is not at all 
what I want. To address this problem, a strict interpretation can be indicated 
by the notation-^. Using that notation, the above goal is equivalent to the 
following expression in the situation calculus. 

Vem,p email- received (em, so) A p - sender(em, s<>) A 
contains (subject (em, s 0 ) , "MAKE MONEY FAST") 

«=> contains-line(p, killfile, s n ) 
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In general, 


HOLDS^^^,{a} n lt s 0 ) = $(s 0 ) => *(<k({a}?, s 0 ) 
ffO££>S(* 4 tf, {«}?.*>) = $(s o )«*tf(d 0 ({a}? f a o ) 

3 A new frame problem 

The representation of information filters presents a challenge. A filter creates 
a new object, such as a text file, which is based on an existing object. Al- 
though the input and output of a filter are distinct objects, they have much 
in common. The output may be a copy of the input, with some (possibly mi- 
nor) changes. For example, gzip, a compression utility, leaves all properties 
of the file the same, with the small difference that the output is compressed 
and the size is different. Explicitly representing all of the ways in which the 
input and the output are the same would be cumbersome, since usually they 
will be more similar than different. For example, if the input of gzip contains 
a picture of the Martian rock named Yogi, then so does the output. If the 
input contains the postscript version of this paper, then so does the output. 
Listing all of these conditional effects explicitly would be impractical. 

This is just a generalization of the frame problem, which is typically 
solved by the STRIPS assumption. The STRIPS assumption is not adequate 
to represent the copying that occurs in filters, since the input and output are 
distinct, and thus any propositions that refer to them will also be distinct. 
What is needed is the ability to explicitly state that the output is identical 
to the input unless stated otherwise. For example, in the case of gzip, one 
should be able to declare that the size and compression of the file are different, 
but in all other respects the files are identical. I refer to such declarations as 
generalized frame effects : The effect frame(x, y) in an action a will be used to 
mean that for any proposition p(x) that holds before the action is executed, 
p(y) will hold afterward, unless p(y) is contradicted by another effect of the 
action. 

Formally, this representation can be described in terms of a second-order 
logic. If R is the set of relations and F is the set of non-one-to-one functions, 
then HOLDS{frame(x, y), a, s )) is equivalent to 

Vp € R \p{x, s ) p(y, do(a, s)) unless 7 J y) (a. ■») V 7 £ tf) (a, s)} 

A V/ G F [f{x, s) = /(y, do{a, s)) unless 3z(7/( tf ) =t (a, s))] 
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which translates to “everything that is true for x before executing a is true for 
y afterward, unless a has some effect that specifies the value of the fluent in 
question.” From this point onward, I will use frame(j, y, a, .s) as a shorthand 
for HOLDS(frame(x,y),a, s)). 

Note that one case has been left out. If f(z, s) = x , the frame declaration 
will not result in f(z,do(a, s )) = y. There is a good reason for this. Since / 
is a function, f(z) can only have one value at a given time. Making f(z) = y 
will result in f(z) ^ x, which is most likely unintended. The above definition 
has the advantage that the consequences of frame will be limited to the copy 
that is being made. If the copy is a newly created entity and all effects 
are limited to the copy, the value of previously true propositions will not be 
affected. 

One might imagine dispensing with the inputs and outputs and represent- 
ing all actions as destructive. Then the STRIPS assumption would preserve 
attributes of the files that don’t change. This would require that all files 
that need to be preserved be explicitly copied [2|. However, doing so merely 
pushes the frame problem into the action copy(_A , / 2 ), since for any propo- 
sition p(fi) that is true before the copy, p{f%) should be true afterward. 
Furthermore, this approach is only applicable in cases where a single input 
is mapped to a single output. It will not help when modeling the effects of 
an action that generates mosaics (combining many images into one), since 
many inputs are mapped to a single output. 

4 Temporal projection 

The structure of goals and effects has some interesting properties when it 
comes to planning. Since the goal contains a part that refers to the initial 
state and a part that refers to the final state, it is possible to simultaneously 
apply regression and progression to the goal, effectively working on it in two 
directions at once. Since the left side of the goal refers to the state of the 
world that the agent is to obtain information about and the right side refers 
to what is to be done with that information, there is no reason to assume that 
working on one side or the other will result in a smaller branching factor. A 
strategy such as least-cost flaw repair (LCFR) [10| could be used to choose 
at each iteration which side to work on. 

Consider a goal of the form A — ► C, and two actions, with effects .4 — ► B 
and B — ► C, respectively. Regressing the goal through the second action 
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results in a goal of the form A -> B. Regressing that through the first action 
results in A — > A. Progressing the goal through the first action results in 
a goal of the form B -> C. Progressing that through the second action 
results in C — ► C. In general, a planner can apply a series of regression and 
progression operators on the goal, until the left side implies the right side 
(and vice versa , in the case of — ►). 

4.1 Successor state axiom 

Following [18], I introduce a successor state axiom , which determines the next 
state after executing action o, based on the previous state. First, I present 
some useful definitions. Following [18], I define the enabling conditions 
and the preservation conditions IT® of p. The enabling conditions follow 
Pednault’s definition, except that p can also be enabled by frame effects. 

£® (y) (s) 7 ^( 0 , s) V (3x(p(x, s) A frame(y,x, a, s) A s))) 

S %(»)( a ) ^ 7 Sv)(°’ s ) V (3xH>(*,s) Aframe(y,x,a,s) A- 7 j (y) (a,-s))) 

A condition is preserved as long as its negation is not enabled. 

n^( y )(s) <=> -, E^ y ,( y ) 

n% (y) (3) _ 'S^( y ) 

The Successor State Axiom states that if condition p is true after exe- 
cuting action a, either a caused p to become true, or p was true originally, 
and a didn’t cause p to become false. 

Theorem 4.1 Successor State Axiom 
p(do(a, s )) E“ (s) V p(s) A n® (s) 

4.2 Regression 

Goal regression is used to determine what must be true prior to executing a 
sequence of actions to ensure that a given condition is true afterward. That 
is, if T is to be true in situation do({a}", s) , what must hold in situation s? 

First, I define regression of the empty plan, {}. Since the temporal extent 
is zero, regression succeeds iff the left side entails the right side 

-> #) = ($ => tf) 

R {} ($ 4 'I') = ($«•*) 
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Regression of a non-empty plan consists of successively regressing each action, 
starting with the last. 


R {a}? (r) = R ai (R a 3 (...R 0 JD)) 

Conjunction, disjunction quantification and negation are handled in the usual 
manner. Namely, R a (r l Ar 2 ) = R a (r l )AR,(r 2 ), R 0 (FiVr 2 ) = R a (rt)vR a (r 2 ), 
R a (->r) = -R a (H, R a (Vxr) = VxR a (r) and R a (3xr) = 3xR a (r). 

Given a goal of the form $ tf, we regress the ^ and leave the $ alone 
(since it already refers to the initial situation). 

R a ($ -►*)=$-► R,(tf) 

Finally, to regress a single literal, f. By the successor state axiom, <p is true if 
it the action makes it true, or if it was true previously and the action doesn’t 
make it false. 


R^) = (s;v(^nj)) 

Regression in adlim is both sound and complete. 

Theorem 4.2 Soundness and Completeness of Goal Regression 

Let a be an axiomatization of the domain theory and the initial state. 
Then a |= ( HOLDS(R {a} ~(T ), (},s 0 ) HOLDS{T, (a}?,s 0 )) 

There is insufficient space in this extended abstract to discuss progression of 
goals, but there will be a discussion of it in the full paper. 

5 Example 

• 

The power of this representation can be seen when composing information- 
processing actions together. For example, in Unix, a common way of copying 
whole directory hierarchies is to create an archive of the files and execute a 
remote command to extract the archive on a target machine. This can be 
accomplished with a single command-line instruction, using the pipe operator 
"I" to redirect the output of one command into the input of the next: 
tar cf - . I rsh target-host * (cd target-dir; tar xf -) * 

The tare action creates a tarfile from the contents of a directory, descend- 
ing the directory hierarchy recursively. To avoid representing the recursion 
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explicitly, tare does not refer to directories, but to pathnames. A file is (re- 
cursively) contained within a directory if the pathname of the directory is a 
prefix of its own pathname. The parent. directory function can also be defined 
in terms of pathname. The output of tare is a newly-created tarfile, contain- 
ing a file-record for each file reachable from the directory. Each file-record 
is identical to the original file, except that it has only a relative pathname, 
and it is not located on any machine. 

action tare (path dp, exec-context ec) 
output : tarfile out 
effect: V f ile(/) ,path(/p) 

(pathname(/) = concatCpd, Ip) A 
host-loc(/) = currenthost(ec)) 

— ► 3 f ile-record(/r) 

frame (/, fr) Ahost-loc(/r) = nil 
contains (out, fr) A 
pathname (fr) = Ip 

exec: "tar cf - dp" 

The tarx action extracts information from the tarfile and creates the cor- 
responding files and directories in a new location. For each file-record in 
the tarfile, a new file is created, identical to the file-record, except that it 
has a new pathname and host location. Although these action descriptions 
omit some minor details, they are essentially complete. The key is the frame 
effects, which stand for a huge number of statements. 

action tarx (path dp, exec-context ec) 
input: tarfile in 

precond: pathname (currentdirectory(ec< n )) - dp 
effect: V f ile-record(/r) ,path(/p) 

(pathname(/r) = Ip A contains (in, fr)) 

3 f ile(/) 

frame (/r, /) A 

host-loc(/) = currenthost(ec) A 
pathname (/) = concat(dp, Ip) 

exec: "tar xf 

The full paper will present a detailed example of how a planner can reason 
about this action sequence, using the temporal projection operators defined 
in Section 4. 
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6 Conclusion and related work 


[ presented ADLIM, an action description language for information manipu- 
lation, which is unique in the ability to concisely represent actions that copy 
all or part of an input to an output. Representing such actions presents a 
generalization of the frame problem, which has not been noted before in the 
planning literature. I presented a solution, using frame effects, and defined 
the semantics of the language in terms of the situation calculus. 

Collage [13] and MVP [2] both automate image manipulation tasks, a 
motivating problem for ADLIM. However, they don’t focus on accurately 
modeling information manipulation. MVP requires actions to destructively 
modify their inputs, relying on the STRIPS assumption to preserve properties 
not listed in the action’s effects. Collage relies solely on abstract action 
decomposition and thus does not need a precise causal theory of the actions. 

Representing actions that manipulate information is related to represent- 
ing sensing actions. Moore (17) devised a theory of knowledge and action, 
based on a variant of the situation calculus with possible-worlds semantics, 
which included an analysis of information-providing effects. I opt for a less ex- 
pressive language, for the sake of tractability. Scherl and Levesque [21] built 
on Moore’s work, providing a solution to the frame problem and knowledge- 
producing actions. The semantics provided for ADLIM closely follows their 
formalization. Son and Baral [22] offer a simpler formalization. 

Adlim follows uwl [5] and SADL [6] in providing an action language 
suitable for softbots, but opts for a more general representation of sensing 
actions. Adlim, like SADL, extends ADL [19], and adopts limited temporal 
quantification for information goals. However, whereas SADL’S sensing ac- 
tions are expressed only partially in terms of conditional effects, adlim’s are 
expressed entirely using conditional effects and “simple observables”. 

There are many other action languages that represent sensing, such as 
[14, 9, 20], but none of them have the expressiveness of ADLIM. They either 
disallow sensing the value of a variable [14, 9, 20], thus restricting sensors to 
returning a finite set of possible values, or they disallow the use of conditional 
effects to describe sensing actions [12, 15, 11, 1, 5|, which is essential for 
representing information outputs that can be manipulated by other actions. 
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